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(57) Abstract: 

PURPOSE: A real-time stereo image matching 
system, which processes video image sequences in 
parallel using an algorithm based on new dynamic 
programming optimized for Bayasian sense, is 
provided to enable stereo matching in real time. 

CONSTITUTION: A real-time stereo image matching 
system includes a signal converter(12), an image 
matching chip(13), and a display(14). The signal 
converter converts images received from the first 
and second cameras(10,1 1) into digital signals. The 
image matching chip calculates a predetermined matching cost from pixel pairs of one scan line of the 
first and second digital image signals and tracks a decision value that decides a minimum matching cost, 
to output the decision value as a disparity estimation value according to predetermined active information 
determining whether the image matching unit is operated or not. The display displays the output of the 
image matching unit. 
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Single -level DPI" 4-§-Sr^ c f. ^^[Peter N. Belhumeur. A Bayeslan approach to binocular ste 
reopsis. International Journal of Computer Vision. 19(3) :237 - 260. l99fi]°il^TT Suh-plxpl RpsnliiMon2|- C-| 
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1^ 4|<4^(23)*r 4^ #3£ 27»S] ifl^ ^3°5 4^4 4^ H M4^H (20.21), = 541^8 ^^(2 
2)1- 414*4. #3 414^(23)0114 #33^ ClkE^ 4^#*fls| 4^*3 44#<>ll £§*Val(4£4 4^ ^ 
3 44t#0°-3 34*4). *Hr*i4^ HS.41-8 ^^(22)4*^ ^ A o v 34^4(20)41 3^4. 414 
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^^^l^cikO^l ^«fl^1 ^^-8-4 °J3€4. -f^S 2fl4^^(20.21)fe- HS.4|Aj <ge]^JE(22)°i] N/2 ^ 
tfl4^S ^^}H3.>4 £7|JJ- ti^^l ^ ^ A o Vo l ^ A o v ^4 N/2-1 ^1^5)4 ^^siol^ *4. 
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xl^Eii-o) a7|ao.5 ^^si^-cii, H54I-8 osl i^l^ 0°U, 4€- £^ =54)^14 4 

^tv ^ cfl 7f ^4. ^£ ^e|4^^ ^nH 4^4 cfloieit 4« ^44 D « 4^^ 44 ^^l^^ sj^l cfl 
4*N tH««4 7H^«4.(CikE°IHfe Cik0°lHfe ^ fl-tf) 



4^ *8^4 ^1^514 =541-8 ^21^^(22)5 °J^Sl7l o|^<( f $4? <$$Q] «y^o| ^i47] ^o)l -° r *t cflo|Ei 

4 ^4*1 €4. °1 fl+^H +^ ^ 2)14^4 (20) cfl441- ?^4°J. 4 444*r SMC(13)4 ^4°fl 
<8** ^4 *«4. nelH.5 CikE44#4 444 N/2-1 7|]4 4°14^ 4« tt44£ ^^44. 



E34l A c! °llel^H(22)5 cfl444 °J^4 #4t11 S|«a. rav ^5:7^ 5+ 444 =54l A J ^ 



- 5 - 



^7^t\ ^2002-0007894 



e)<dH(22)£: «1 H (Activation bit) 7> 1^34. ^eltiS 0(22)fe «l£7> «M 

^4s.ia^^ji4* ss^-a ^^^^(1^^(22)^ -a^^. *m A^Efloj ^ H|E^ D j A]^ia# 

W\ Sfl 4 *M ^ Eg 01 xL5.^>y <^^^h(22)B] ^«B^1 »7| fl*>o| S.^ 

^m(22)^j #e)£ a ^43^ -sW7> S|<H 0 > ^cf. 



(- 1.0. +04 §°] ^eii^i a* n^^i °<f°J4 a mls+ej ^i^h ^44 $ 

ufeH)?IM- 4 <g4'SH(22)4 #3<?1 -a^l *oV*l- 7f*l ^ Sjcf. 

4 ^el^H ( 22)^ £ 3<H1 454 £o) *}« 0 v HS.4H( 3 o), ^3(31). W = 5*1M (32)5 

€4. 

E5>W(30)4 ^Ai]5l7j- £ 4°H £A|s)<H flc*. 

*£(41)te- 4-% ^ efl4^4(20)4 4H Rin ^ 4^ ^ v efl4^4(21)4 4l3 Lin*) *}cfl# 4 
3^ 3.^3.% 711^*4. 7-1]^^ 3}^ ^^H^r 7K+7|(42)4H 4H«ia i2^B4 7}^^r. 4 3 
# 4*£ n ^^^^(22)21 #*fl S^o,] 7K>SU. 4^4(43)4 °J 3 *V4-7> €4. 



4^4(43)4 4«-t-113£ S3>W *!4^(22)4 #3 UouHl 44 <a£«4(Ulnl 5! U 

in2). 4H4(43)fe 371)2] %± Stir ti^U 4 t44 7^)1^ nflnfcf AflSL^ *U|] 3.^7} 

44 5L±£ *M^4(44)°fl 4#€4. ti43 °d34 4K ; i ; 3&)£Uin4 4£4<3 - 1, Uin24 44:43 +1. 4 
g 3 +0 |„, 0 o]£)ji ( ol ^o. Dfout o. S #4*14. 

42 7R.M-CT 5L^H ell 4^4(44)°il 4#*! #4 H^E4 £~t^ Co# 7K144 Uout H 
^2)^^(22)5. t^tVuf. o)nfl ^f-^^ Co ^ ^|aV^ ^ ft d U. °1 ^ «fl S^S^ clSll^A^ o)-^^ 

^^^^(22)^1 ^^^i^i-. 

a^S ^(31)£ >M)7H2) 7^« ^^fiti: ^W7l 2«1H efl^l^ElS ^£)<H ^fl tit **|iS. 

^^(31)2) ^£7>£5*HI E^1S|<H M4. 



^^(31) OlolE) r/w Aijg. AH) o] ^ ^o]S4. ZLS-tf]*] (30) 2) Dfout°H «1« D 

sin ti5i7> ±e»(31)*H ^^^14. ^1 MUX(50)^ «1 2 7| (43)^1^1 #^s)b ^^3t4 42 ^ eflx]^E)( 5 3) 
oflA] S^ft^ ti^^cf. ^]i eJl^liiEl(51)fe ^1 MUX(50)°H^ ti^« ^^tt* 

Jf* «3.^1(32)SDsout ^>l-f *M ^12 MUX (52)^^11 efl^^(51)<H|^ ti^^ll^a^ 

2)H^^! v *>M-«- ti«!*>2. A2 ^ efl^l^E)(53)^ ^12 MUX(52)<H|-M ti^!€ ^=8 fit* ^I^U ^12 M 

UX(52)£ ^)H^t>4. 



as^^( 32 )fe al^S) **** 71^4 ^« 0 V HS4W( 32 )3 iW£7f H 6^1 £A|sl<H ^cf. 



E54^1(32)^ *)#*Kr «<j ell^^El(61)l- Sd4. ^elH u lH7^ ^o] A o VEfloj 

=5.^^1(32) ^o] OR Tllolje (60)^ ES-^I^ ^e)^H(22)^ ^ «1H ^5.(Ainl, Ain 

2)4 Ji!H«J)3 »1H ^^(AselOl" Ainl °fefl°fl fl*l« HS.^1^ ^2)^^(22)4 Aout2 

ti^SloL, Ain2fe fl<fl fl^l* ^5)^S(22)4 Aoutl ^Hl ^1 ^^14^ xl^. °1 §^ 

«1^7> *t£*J 4E}MU, o)f- ojs) -oflAi ^ ti|E 7 > ^o| A^Eflo)^ OR TlM* (60)4 #3°1 *H A o V ^7F 
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OR ^llolE^o) <$^ % Aself ^ gj» #e)o] oJ 7 ^ a ^ ofl ^ ^Eflf. ^ 

H(32)*r 3^^ DEMUX(G2)1 ^1]<H*>^1 £3 ^^(31)^ DsouHl DbtrH) 5Uir Site D 

EMUX(62)£) Aoutl, Aself. Aout2°J3l °lt-°r Dbin^l zfz* - 1 , 0. + 1 <S 3 £^ alJM- 7> 

£3 «lm7> 6-M ^Eflo]^ 3 Aj-E|) *]2)(63)7 r Dbin*] Dbout^-S. t^^cf. ne] JI *l Zk°) ^3*1 

£*l SMC(13H<*1 #334. 3<M tt)3l(63)b JL slcH 41- ^ W.M)M(32)2\ 

4€ #3 Dbin DbouHl #3*Hr 3!*|c|-. Dbin-I- #e)*Hr »J-*]°IM£ <#oj*). 

M-Efifl^ 7joj cflt ujx^ t3*Rr "o v *HM^ -a^sl <9=9i^ ft« M-Ej-tflb 

1. £715)- : !c!= 0* J2-^ ^HS] «l-g-ir -7-^0)51 *!3#cK 
U[0,0]=0 

U[0j]=oo,jG{l N-l} 

2. 7.1)9] : 4 a}o|e ,o]l cfl*M 7« $-£ 7$$.*} 3^4. 
For i-1 to 2N do: 

For eachje{0 N-l}: 

if i+j is even 

P\ij\ - org miti lf . ( ., <0>)) C4i-l.J+ft| i 

if i+j is odd 

3. 
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d[2N] = P[2N. 0] 
Fori=2N-l to 0 do: 

##P[ij]£ 33 >^(3iH *13^4. £3 >:ej(31)-§r 3$ *fl<H$4. *d u o v ^Bfl^ *J u o v 

*5L4H(30H 3*fl ^IjSU. (32) «fl S)sfl ^fl^ck 

5. J££ -SHoil cflsH *)el«cf. 3*f*l°.£. IV 7H^ H3.>H)^ ^e)^H(22)^ ^Hl^r #*1<S£ o] 
°H <M-zHH 4 t^^r S c l. 

•1* 33 ^(31) 

2. 33 A«l 

33 ^(31)£ N $1 = 3. LIFO (Last -In First -Out) 3l*]^tH ae)Jl zj-z^ flHfc 2«lS5. ? 

4«=K 443 2.&m «e]*!H(22)»M- # 71151 33 ^(31)<>1 5Ut. # H o v = sL4H (30)^1 **HI m ^ 
floq *H#*Hr P[g]b33 **aa^(32) W 33tf£ #3€<}. 

3. *»*»*fl*?i 

tfjL2)#S) ^2:7} £6^1 *# *1 3l# 33 ^(31)2] «>ifl 

si°£ c r &4 30] 
P[1J] for i = 2N- 1 toO 

i = 2N<HM 1 efl*U3(61) a[0j]« *fl*l £ a[0,0]£ 2:7] # z| * # 

(32) *l r +-8-4 ?>r+. 
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£3(Aself) : a[i+lj] 6 (P[i+lj]). 
tfU-#3(Aoiic2) :a[i+lj+l] 6 (1 - P[i+ 1 
*f w <)-£3(Aoutl) :a[i+IJ-l] 6 (- 1 -P[1+1J- 1]) 

P'liJ] = atiJJPliJ] 

31- T-t-M?!- ^o.nl iofl d)^ P[i.j]2] #3£ P[i]5. I <a§H tM <&4% 

^-tf-fr sMaJt! U-tV*}*) ^^-l- ^tfl^ltl 0 J"t^M 5J°l c h 
* -SM < 4°il £ ^s) 4tf hhh 334*11 3$ 7>*#-fr tS«lcf. 

«>3 *«1 £ t^l 4S<3, Bayesian Sensed 3)3^3 JflS* S£aefl° 0 Hl <£ol5l£$ 4* 

«H °H*1 A l€i S-S- 'Stt *|e1«£.s^ -gAi^os iEWi ^flo] 7B?*V5E.a Jl^7> Sic)-. 

(57) y-i'-sl 

1. 

41 % 42 ?He]-£^El -y^slfe- <8tft- ci*m x|£3. 43. 

^•7) * *1|2 cWa <§U"fcU2l isffl al- 0 j2l si -a ir°s.%-E] ±$2\ aist t)|-lVsU 3^ 2 a 

S# WHr 4>*j*H «■ ^^aj */■¥•«• 13*Rr tf-tj 3lM 4^ tf7| <#°J*I- 4> 

#7| 4&t4°l s>7l f)« c|£*eM aft^fc °d*fl 3$ ^'d. 
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*<H #4 3#*>fe #7) 4l ?He>S^El «<H*lfe W3.2. 

^ <a# #* 

4 lW Jtl°W. #7) <3# #* ^<cHM #?1 W$ sigfe 

#7| 4l S =0)2 a) -ail #7) sj^o) ft* #*°J ^Jtt itt*M 4#*Hr 5!t 

43 £.£ °J4 <3# #iL *li>g. 

'II 1*4 °1<>H av v] ^jjLfe 

#7| 4l ?H^°I1 =Wa <3# ^i^fe =41 *1#n-tf; 
#7| ^2 ?Mel-<Hl si* cH<B <3# 3€-§-*1#*Hr 42 a^tf; 

#7] 4i 42 ^^^S^-el i^sl <£ou> ^#*lf- #3*H=- H3.4# * 

#7i 4i $ 42 *1#^£4 Aj. 7 i h3.au> ^^s) 4<h«^7| *|* #ej& 4**K? #3 4<H<r££ £fl*Ht 

tffe ^Al^V °j4 <gAj. 33. A)i^. 

4 4W ««H*I. 

#7i hs.4# N7H, #7] 4i SJ 42 *l#^&-& N/27BS. 2& 4# o.a <gafl <gtf ^ 

3?* 6. 

4 5*4 5a°H. #7] =3.4-8 <rtf-& °1* ^fe HS4# ^£4 #.a.f- $!•§• #.<MtJ 

°J4 "3# 3* <M&^. 

4 5U°W, #7i N4fi) «s.4# ^r<3 ^ 

i#el <S°Va}§ #3*Hr S34# t^-lH sU <4°H = 3.4# r^ti- :a °Jo)cj^. aj.^ ^]t}^ 3 

•g- SVrr <$ 4 <S# ^tt 

3j-?*8. 

4 4*4 Xl<>H. #7l 4l ^ 42 *U v ^tf€- #71 H34# ^<Z°-sL * i'Jl 2*°J2| s|"go| gss|S £7l# s)fe 

^•g- 4=85.3. *>}r -a*m <a4 •£# #* <M^"yi. 

4 4*4 5a°H. #7l 4i ^#^^4 1#s|te #7| #34 sl«fl ^#^.4 N/2- 1 *l<aslfe S* 4=8 

s-s -a 4 "^# a i^ e j. 
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3?*<f 10. 

H 4*<M fl°M. ^7) #e} H<H 

A o v 7) *^<*)*8 HS^fl^sj- ^7| H2 s^tHI Hi €34 ^71 i-T^fll HS-H-MSf Aj. 7 | Hi aj^'cH] 

*^s]fe- H2 t^sffe ^3 S-S. s}b -MAjzi ojh Stf 

11. 

^7| Hi $ H2 W^S) £ ej-ols) ^-gf- <a^«.s *M ±^2] 2il $ TJ^^-I- f-^sVfe- Hi =3. 
H i ESHWI WHr 33 $ 

#7] i^fi) #Aj ^jio)) sjaj) av 7 | ^tHH #^£)fe 4:^2) #3*Hr 4]2 HS-H-M 

t zmt *m 4wa •gtf Ai£<a. 

12. 

H u^H fl<>W. 

si^oflAl i7l ^HA]5;7l- <ae)5]£ A o v 7 ] s^ha^ 3*4H j]7i H<H-i!£7V oj^s)^ tf 7 | H2 5.5. 

1*W 5!* 3-3 ££ 41*13 ojh oj,£ 3^ Aii^. 

13. 

*il llW ^71 4^ XW^-Z 

AJ-71 Hi HS.HaHa1 7>^- i+^ofl ^71 H2 EiMH 6 !! ^ °J^£)fe H <H2l 

2£ £ 3-g- ^ os. ^A)?i oJH ajA}. Al&<i 

14. 

H n^SM flo)Ai. Hi HiiH^fe 

a>71 Jili 5J jfl2 a^K^fil «v r+oje) si-gs^R) aiEf Ha±sH=. sig H*i ^<eh 

■S-7] Tfl-tV^l iaiSS). B]c»4€ ^H Sill 7>Aj.^fe. Hi 7fA> 

^71 Hi 7>AV ^#2] #34 ^7) o]*j£ nS-HAj ^£2] 2iS§ H]H*H 7># ^"8: SiS ^ £ ^ ft* t3*lfe 
A^7l a|J2 12). 7)-# *}-.& 2iSf *}H SiES. a] ^^0; 

a^7| #H Si§S} iffti ^fil- 7>AV*}^ <y^ n^^Aj ^ig.o.s. £e)e}£- ^-7| H2 7teK*£-& ^.g- 

^=8*3. -yAjTj. <yn ^ A] iE j. 
^^*<^ 15. 
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*i| 1 1 SH *\ . A <M 3 3 ^ 

3?1 a|H^e<HH #s|S|fc 33&4 3)s.^€ °I3 A <Ns) 33& * «Wf -idsisHr 

33 i^fe ^3 *^ -jm** , 8*ii w 3tr ^■a. 

3?*o V 16. 

4 m<$ 5U°H. A cM 

#7] i7| ^<HA) £ o)| ojifl AJ-7] aU^oM #33^7 33&£ 4H*3, A cM tl?) *1H -il^oll 5)811 3?1 33 (| 

33&£ tfajsHr 3-s- *3°s. ^ -a^in ^ 

3?*^ 17. 

all 111M Slol-H. 3?1 *]2 = 

3?l Sl3$ 5MH ^£21 §3 3Ji 3£4 *4 3ji fee)^ s>fe fcejtf 

3?l feel* 34 aif'S] £3 =9 a. U a 33.1- efl*|>nH; 

Aj7] 33 33^<cH)*l t^slfe 335M "44 3?l n*\^2\ m S3 3>£ 3£f- *H 3?1 £3 = S 
37] efl*l^sl §^ ^^o)] utej- ^Itf'rVHM -i^^i^si <tfo> ^*l5= f^*Hr *HS|-& 

£tWfc 5!* 4=3 is «te ^13 mi 33- 33- 3^. 



171MI 5tl«H*l. 3?l 33 ^13^^ £3£ 3?1 cff^sf S3 3*L *lM*Kr 3i£ m°2. 

333 °j«n 33 3*& 3^<a. 



3-73 18. 



10 
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V.Vi 2 



,20 



«V 



.22 



Lin U>2 Uout tttf Aout2 



Dout 



3 



lin Uin2 Uoul AIn2 tou(2 
' oout 
Rin Uout Ifinl Aout! Ami 



TTTT 



1 k. 



*A 




SIM 


CO 



Lin UM2 uout «n2 Aout2 
Rin Uout tfnl tout I Akil 



tin Uin2 Uout Mi2 Aout2 



F/B 

Rin Uout Unl Aoutl AInt 

_j 



Lin Uin2 Uout 
.30 



Lin Uin2 



Uout 



Rin _ Uinl 



Ofout 



Clock - 

F/B- 
(W/R) 



,31 



Rin Uout Uin1 



Dsout 

Osin F/B(W/R) 



.32 



Ain2 Aout2 
Obin Dbout — i 




Oout 



Aoutl Ain1 
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Un Uin2 
9 t[(;-j+1)/2] U[i l.jilJiC. 



Rio Uin1 

g'[0+j+O/2] u[i-i. )-i]+Co 



Uout 
U[I-1.j]+Co 




Uout 

U[i-1.j]+Co 



Dsout 




A!n2 



Aout2 



Dbin ■ 



Aself 



61 



62 
DEMUX 




* Obout 
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